Entropy-Based Independence Test
نویسندگان
چکیده
This paper presents a new test of independence (linear and nonlinear) among distributions, based on the entropy of Shannon. The main advantages of the presented approach are the fact that this measure does not need to assume any type of theoretical probability distribution and has the ability to capture the linear and nonlinear dependencies, without requiring the specification of any kind of dependence model.
منابع مشابه
Spatial Association of Qualitative Data: A New Test Using Symbolic Dynamics
In the present paper, we construct a simple, consistent and powerful test for qualitative spatial independence, called the TG test, by using symbolic dynamics and symbolic entropy as a measure of spatial dependence. We also give a standard asymptotic distribution of an affine transformation of the symbolic entropy under the null hypothesis of independence in the spatial qualitative process. Giv...
متن کاملA Non-Parametric Independence Test Using Permutation Entropy
In the present paper we construct a new, simple and powerful test for independence by using symbolic dynamics and permutation entropy as a measure of serial dependence. We also give the asymptotic distribution of an affine transformation of the permutation entropy under the null hypothesis of independence. An application to several daily financial time series illustrates our approach.
متن کاملBayesian Test of Significance for Conditional Independence: The Multinomial Model
Conditional independence tests have received special attention lately in machine learning and computational intelligence related literature as an important indicator of the relationship among the variables used by their models. In the field of probabilistic graphical models, which includes Bayesian network models, conditional independence tests are especially important for the task of learning ...
متن کاملTesting Conditional Independence for Continuous Random Variables
A common statistical problem is the testing of independence of two (response) variables conditionally on a third (control) variable. In the first part of this paper, we extend Hoeffding’s concept of estimability of degree r to testability of degree r, and show that independence is testable of degree two, while conditional independence is not testable of any degree if the control variable is con...
متن کاملCombinatorial Independence in Measurable Dynamics
We develop a fine-scale local analysis of measure entropy and measure sequence entropy based on combinatorial independence. The concepts of measure IE-tuples and measure IN-tuples are introduced and studied in analogy with their counterparts in topological dynamics. Local characterizations of the Pinsker von Neumann algebra and its sequence entropy analogue are given in terms of combinatorial i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007